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METHOD FOR CONVERTING 2D IMAGE INTO PSEUDO 3D IMAGE 
AND USER-ADAPTED TOTAL COORDINATION METHOD IN USE 
ARTIFICIAL INTELLIGENCE, AND SERVICE BUSINESS METHOD 

THEREOF 

5 



Technical Field 

The present invention relates to a method of user-adapted, artificial 
intelligence-based total clothes coordination using conversion of a 2D image into 

10 a pseudo-3D image, and a service business method using the same. More 
particularly, the present invention relates to a method of generating the 
pseudo-3D image, which depicts an image having the same visual and functional 
qualities as those of a 3D model, from the 2D image in a virtual space, a method 
of generating a pseudo-3D user-adapted avatar, a method of deriving a total 

15 clothes coordination style suitable to the tastes of a user by using artificial 
intelligence, a method of acquiring know-how reflecting usage results, a service 
method for inserting an e-commeree system module, and a service method for 
ordering, producing and selling goods from the pseudo-3D total clothes 
coordination system. 

20 One of the applicants of the present invention previously filed the 

following with the Korean Intellectual Property Office (KIPO): "Coordination 
Operation System Using a Network and the Operation Method Thereof (Korean 
Patent No. 413610) and "Coordination Operation System and Coordination 
Suggestion Method Thereof (Korean Patent Laid-Open Publication No. 

25 2003-83453). 

Background Art 

Nowadays, various simulation programs provide indirect experiences in 
virtual spaces using computers. Particularly, as business in Internet virtual 
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shopping malls, namely e-comraerce systems, are becoming more active, 
development of a virtual simulation system, in which a user is able to make 
realistic sensory evaluations before buying goods, is needed. 

In order to provide a real-time virtual simulation, systems of both a 
5 provider server and a user terminal should have high specifications. 

Nowadays, 2D simulation systems are widely used, but 3D simulation 
systems are being developed. 2D simulation systems have advantages in 
viewpoint of costs and time, because 2D simulation systems do not need 
real-time processing and high specifications. However, 2D simulation systems 
10 also have disadvantages in viewpoint of visual quality and other functions, in 
comparison with 3D simulation systems. 

Particularly, visual quality may be very important in a clothes 
coordination system. 

The clothes coordination system in a virtual space is actively being 
15 researched in the fashion field, and is explained in the present application using 
examples of clothes and fashion. 

Most of conventional virtual clothes coordinatiGn systems are dependent 
on 2D images. The 3D clothes coordination systems in virtual space are needed 
for improving customer satisfaction, by providing appropriate clothes 
20 coordination matching a body shape and tastes of the customer. The 3D clothes 
coordination system may be developed by constructing a database of 3D clothes 
model and by matching the 3D clothes model to the body shape of the customer. 

Korean Patent No. 373115 discloses a method of managing an Internet 
fashion mall based on a coordination simulation system. Korean Patent 
25 Laid-Open Publication No. 2002-3581 discloses a method and an apparatus of 
serving fashion coordination information by using personal information such as 
tastes, biorhythm and so on. Korean Patent Laid-Open Publication No. 
2002-77623 discloses a service system that provides coordination information 
based on weather information, and a method of managing the system. 
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Japanese Patent Laid-Open Publication No. 2001-344481 discloses an 
Internet boutique system combining an item with an image of a customer and a 
selling method. Japanese Patent Laid-Open Publication No. 2002-373266 
discloses a fashion coordination system of selling items appropriate to 
5 information of a customer's body shape and a method using the same. Japanese 
Patent Laid-Open Publication No. 2003-30496 discloses a fashion coordination 
system of selling items according to a place and time of the customer and a 
method using the same. Japanese Patent Laid-Open Publication No. 2003-99510 
discloses a service method for fashion coordination by receiving fashion 

10 comments from a third party. 

Korean Patent No. 373115 discloses a method of managing an 
Internet-based e-commerce fashion mall in which items may be purchased after 
being shown three-dimensionally through a coordination simulation window, in 
which an entertainer, an ordinary person or a customer may be a model for the 

15 items selected in the fashion mall. 

On the other hand, the method of the present invention comprises 
generating a 3D user-adapted avatar similar to a body shape of a user, by 
referring to standard coordination condition data; extracting and showing items 
corresponding to response data selected by a user; offering various alternative 

20 simulations in which a character wears the items extracted unspecifically from 
the response data; and suggesting a coordination selected directly by a supplier, 
which provides the coordination items. Therefore, the present invention and 
Korean Patent No. 3731 15 have substantial technical differences. 

Korean Patent Laid-Open Publication No. 2002-3581 discloses a method 

25 of selling items by generating fashion coordination information appropriate to an 
Internet user by using information including personal data such as age, sex, job, 
body shape and so on; fashion tastes such as preferred trends in fashion, colors 
and the like; a biorhythm calculated using personal information, weather, fortune, 
and so on, by e-mailing the fashion coordination information daily or 
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periodically, and researched items corresponding to the fashion coordination 
information of the Internet user. 

The above conventional method comprises transmitting coordination 
information, sorting items accordingly and selling an item. On the other hand, the 
5 present invention discloses a method of displaying a user-adapted 3D avatar 
coordinated visually by presenting a 3D avatar similar to the user's body shape, 
by referring to the user's responses and renewing the AI database by acquiring 
tastes and trends of the user from self-coordination. Therefore, the present 
invention and Korean Patent Laid-Open Publication No. 2002-3581 have 
10 substantial technical differences. 

Japanese Patent Laid-Open Publication No. 2001-344481 discloses an 
Internet boutique system for selling, using total clothes coordination. The user of 
the Internet boutique uploads their own images, combines the images with 
images of selected items sold from the Internet boutique, checks the combined 
15 images and buys the desired items. 

However, the above conventional system provides a desired coordination 
to the user appropriately by receiving at least one condition from the user 
connected to the coordination system through an online medium. Therefore, the 
present invention and Japanese Patent Laid-Open Publication No. 2001-344481 
20 have substantial technical differences. 

In South Korea, 2D coordination simulation systems using mannequins, 
photo images and 2D images are widely used, and 3D coordination simulation 
systems are being developed in universities such as Myongji University, Seoul 
National University and the like, and research and development are also in 
25 progress in companies. However, studies with comprehensive vision and scope 
have not yet been performed, and companies also have not yet performed 
comprehensive research and development. 

In the U.S., Japan and the like, digital fashion simulation systems are 
being developed competitively, and also in Europe, digital fashion simulation 
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systems are being actively studied among companies. 

In the U.S., the Department of Energy (DOE) has been promoting the 
Demand Activated Manufacturing Architecture (DAMA) Project with more than 
10 laboratories under direct government control, such as the Los Alamos 
5 National Laboratory, the Brookhaven National Laboratory and so on, textile 
research institutions, and 150 companies such as DuPont, and Milliken & 
Company that established the American Textile Partnership (AMTEX) and have 
been promoting studies about system analysis, simulations, 3D sewing and the 
like since 1993. 

10 The Japanese government has promoted development of clothes-wearing 

simulation systems using depiction of a character and clothes using scaling data 
of the human body and Virtual/Augmented Reality, through industry-academic 
cooperation, such as "The Vision of the Textile Industry in the 21 ^'Century in 
Japan" project and the like, as part of a policy for the highly developed textile 

15 industry. 

In Europe, especially in the U.K., research has been mainly conducted at 
the University of Leeds and the University of Bradford. In Sweden, the 
government has promoted the STRAP Project centering around the Swedish 
Institute for Fiber and Polymer (IFP) Research. Research has also been actively 
20 conducted at the University of Minho of Portugal, the Council for Scientific and 
Industrial Research (CSIR) of South Africa, the Commonwealth Scientific and 
Industrial Research Organisation (CSIRO) of Australia, the Wool Research 
Organisation of New Zealand (WRONZ) and the like. 

Foreign companies, particularly CAD/CAM enterprises (Lectra, Gerber, 
25 Asahi, Optitex, Toyobo, Browzwear and the like) have taken interest in fashion 
simulation systems and are developing nearly on a commercial scale. 

In schools and laboratories, MIRALab of Switzerland, the Dresden 
University of Technology of Germany and the like have written several papers 
about developing the simulations and the like but nothing on a conunercial scale, 
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and parts of papers have fociised on drape simulation systems. Despite overseas 
interest and research, commercialized fashion simulation technology has not yet 
been presented. 

A company having a website www.kl23.co.kr provides a fashion 
5 coordination system that adjusts the size of a clothes image from another website 
to the size of an avatar of the website. A method to create an individual's 
character includes using a facial image of the avatar or substituting a facial image 
of the customer with the face image of the avatar. The system creates a character 
using the facial image of the customer and coordinates the character by fetching a 

10 desired clothes image from another website. However, because the avatar using 
the facial image of the customer does not reflect a body shape of the customer, 
the avatar is not appropriate for representing an individual's body shape. It is also 
difficult to revise a wide variety of clothes images from another website with 
correct sizes, colors and patterns. 

15 A company having a website www.lavata.net provides a solution for a 

user to buy clothes after directly viewing an avatar. The company manages a 
system similar to the company having a website www.kr23.co.kr. The system 
coordinates an avatar by changing a face of the avatar having a photo image like 
that of a mannequin to a face of the user. The system coordinates by using the 

20 face of the user, and changes the clothes by using a photo, so that the system has 
an effect like that of a customer directly wearing the item because there are no 
change in wrinkles and shapes. However, the avatar is not appropriate to a model 
of an individual's character because the avatar is not considered to represent the 
body shape of the user. The body shape of the avatar using the mannequin model 

25 cannot be changed. Also, it is impossible to change colors, patterns and sizes of 
the clothes using the photo image. 

A company having a website www.handa.co.kr provides a coordination 
system that puts a clothes image on a photo model using a real model. The 
company provides a method of manual coordination by uploading a photo of a 
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user and a method of coordinating a clothes image to a photo model. The system 
has a low effective value as a coordination system because the system requires 
the models be manually coordinated one by one according to a posture of the 
photo model, and the selection of clothes is also small. On the other hand, 
5 individual coordination by a user uploading their own photo is possible through 
the coordination system. 

The Next Generation Apparel Related CAD and Information System 
(NARCIS-DS) system developed by Design & Measurement (D&M) 
Technology Co., Ltd. is a virtual dressing system that generates a 3D model, 

10 which can be dressed in a virtual space. The system provides easy texture 
mapping and changing of colors. The system creates the 3D body model by an 
offline module such as a 3D scanner, creates clothes using a 2D pattern CAD, 
and then fits the clothes to the 3D body model The system features a fully 
rotatable 3D model for viewing from all sides, manual control of gaps and 

15 collisions between the clothes texture and the model, and automatic dressing of 
the virtual model. 

The Virtual Wearing System (VWS25) system generates a pseudo-3D 
lattice model for a clothes image, performs pattern mapping, corrects colors and 
then presents various fashion styles and colors. VWS25 presents coordination in 

20 which patterns may be freely selected, and a visual quality similar to the 3D 
simulation. However, change of clothes size and coordination according to an 
individual's body shape is impossible because a photo model wears the clothes, 
and not a model matching an individuars body shape. 

Digital Fashion, Ltd. of Japan manufactures modules for clothes to fashion 

25 shows, and provides the modules to famous websites in Japan like 
www.benetton.co.jp, http://mainc.jp and so on. The system generates a 3D model 
of a user by a 3D scanner, measures 27 parts of a body and generates an 
individual's character model using the measured data. The system comprises 
cutting and sewing 2D CAD patterns of the clothes, and fitting the clothes to the 
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individual's character 3D model. The clothes are created for the 3D model, and 
pattern mapping and changing of colors are possible. The user can show the 3D 
model dressed naturally by physical techniques. Nevertheless, to generate an 
individual's own character, the model can be adjusted by region, but the resulting 
5 model after the change is unnatural. Also, the system has low visual quality 
because only 3D models are used, and requires a long time to load so that it is not 
easy to use for online purposes. 

My Virtual Model, Inc., which develops 3D simulation systems in the 
U.S., provides a system that creates an individual's character model, puts clothes 
•10 on the individual's character model by creating the clothes provided by each 
clothes company in 3D according to a model. The system realistically depicts the 
character model by mapping a skin color to a 3D model, and coordinates 
according to body shape by creating models by body shapes. However, the 3D 
shapes of the clothes have differences from real clothes in designs, colors and the 
15 like, and the resulting dressed model seems unnatural. 

Optitex, Inc., which develops 2D/3D CAD/CAM solutions in New York 
City, U.S.A., focuses in creating and mapping textiles. The system of the 
company maps various textiles according to clothes and corrects colors. The 
company developed the Runway Designer module, which is a fitting system 
20 using a 3D model in a virtual space. The module cause shapes and colors of 
patterns to seem natural, but the resulting dressed 3D model seems unnatural. 

MIRALab, which is a laboratory at the University of Geneva in 
Switzerland, has developed modules for coordination simulation in a virtual 
space. MIRALab is administered by Professor Nadia Magnenat-Thalmann, who 
25 is an expert of coordination simulation systems, and has authored a high number 
of research papers and developed technologies, with regard to physical and 
geometrical methods relating to 3D simulations and modeling virtual humans. 
The laboratory developed the coordination simulation module, which creates an 
individual's character by changing an entire human body model to that of an 
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individual, and puts the clothes on the individual's character by a physical 
method. The module features high visual quality through textile mapping, color 
correction and so on, because the human body model and the clothes are 
developed in 3D. However, it takes a long time from creating the clothes to 
5 putting the clothes on the individual's character, and currently, only simple 
fashion styles can be put on the individual's character. 

The conventional coordination service systems have low image quality 
when sizes are corrected, and as a result, all images must be made in advance and 
thus, have a limitation with respect to image depictions. The limitation is that 

10 only a limited combination of images can be made in advance. However, the 
ability to correct patterns and colors of images sizes are corrected can result in an 
infinite number of fashion coordination combinations. Therefore, the clothes 
images should be created in 3D in order to freely create fashion coordination 
combinations. Because corrections of sizes, pattems and colors in a 3D 

15 simulation system are possible, only a few standard images and pattems are 
needed; thus, an infinite number of resulting images may be created. 

However, in case of generating images in 3D, the costs of producing 3D 
images are high and there are differences in loading speed and image quality 
according to a number of vertex points that are used to create a 3D model. That is, 

20 the image quality decreases but the loading speed of images increases when 
using a lower number of vertex points, and the image quality increases but the 
loading speed of images decreases when using a higher number of vertex points. 
Also, memory usage is high and a large amount of hard disk storage capacity is 
occupied when operating, because 3D simulation systems use vertex point data 

25 and surface data. 

The conventional coordination simulation systems create human body 
models, fashion items and clothes in 3D. Due to items being depicted in 3D, most 
systems are configured to display items only having simple and plain shapes 
rather than diverse items, and are not nearly on a commercial scale. The system 
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of the present invention is configured as a total clothes coordination simulation 
system unlike the conventional coordination simulation systems with respect to 
costs and diversity, by generating pseudo-3D images and is nearly on a 
commercial scale. 

5 The conventional patents and systems using weather information, 

biorhythms and the like, cannot obtain optimum coordination because 
coordination is performed using database combinations, that is, by referring to 
given fashion information. Therefore, conventional coordination service systems 
typically do not suit the tastes of the user and are not realistic, because the system 
10 coordinates using given information fi-om mannequins, 2D avatars, photos and 
the like, and do not consider the body shape of the user. Particularly, the 
conventional coordination service systems on websites typically show systems 
that simply allow the user to put the clothes on a fixed, existing avatar such as a 
mannequin. 

15 Nowadays, an advanced Internet-based system is in demand, in which 

custom-made items, fashion, clothes and the like are developed, the orders are 
planned, produced, inspected and delivered after the user orders the items, and in 
which the user can confirm the order through a realistic simulation in real time. 
In most e-commerce websites some of the coordination simulation technologies 

20 are applied, but creating and sellmg through the simulation systems are not 
applied. 

Disclosure of the Invention 
Technical Problem 

25 The present invention provides a method of pseudo-3D total clothes 

coordination, which has fast loading times, and reduces memory usage by 
generating coordination images in 3D and intemally processing images in 2D, 
providing diverse styles while providing cost and time savings for development 
of the coordination images. 
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The present invention also provides a method of generating pseudo-3D 
images, which may save costs and improve image quality by causing 2D images 
to operate like 3D images visually and functionally. 

The present invention also provides a method of pseudo-3D user-adapted 
5 coordination, which coordinates styles suitable to a body shape of the user by 
generating the pseudo-3D user-adapted avatar suitable to the body shape of the 
user by using a database. 

The present invention also provides a pseudo-3D total clothes 
coordination system, which is a total clothes coordination simulation system that 
10 uses pseudo-3D images and pseudo-3D user-adapted avatars. 

The present invention also provides a method of pseudo-3D total clothes 
coordination using artificial intelligence, which may provide information about 
user-adapted coordination by learning coordination styles. 

The present invention also provides a service business method of guiding 
15 a seller in selling items by providing a module to the seller who wants to use a 
pseudo-3D coordination program. 

The present invention also provides a service business method of guiding 
with respect to custom-made orders, production, and selling using the pseudo-3D 
coordination program. 
20 Technical Solution 

A pseudo-3D total clothes coordination method according to an example 
embodiment of the present invention includes preparing a 2D standard avatar 
image, a standard 2D image and a pseudo-3D image; entering a user's 
information; generating a pseudo-3D user-adapted avatar image by correcting the 
25 2D standard avatar image automatically according to the user information; and 
performing an automatic coordination by converting the standard 2D image to 
the pseudo-3D coordination image in response to the corrected pseudo-3D 
user-adapted avatar image according to the user information. 

According to an example embodiment of the present invention, generating 
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the pseudo-3D image includes preparing a red-green-blue (RGB)-format 2D 
image; converting the 2D image to a hue-saturation-intensity (HSI)-format 
image; obtaining a control point of a polynomial function according to an 
brightness distribution chart of the HSI-formed image; producing a virtual 2D 
5 development figure by applying a physical technique to the 3D curved surface; 
mapping a pattem to the 3D curved surface by using the coordinate values of the 
virtual 2D development figure; and generating the pseudo-3D image by applying 
a shading function to the pattern-mapped 3D curved surface. 

That is, the HSI channel value is obtained from the 2D formed image. The 

10 intensity value distribution chart is obtained from the intensity value in the HSI 
channel, and a maximum value and a minimum value passed by each curved 
surface are obtained from an equation of a multidimensional cxirved surface 
formed the distribution chart. Control points are fixed fi-om the maximum value 
and the minimum value and a surface having a smooth curved surface is created 

1 5 by applying the B-spline equation. A 3D formed image is created by applying the 
shading function to a pixel value, when projecting the surface to the 2D form, 
and a projected angle. The present me*od includes obtaining the 3D formed 
image from the 2D image, unlike the conventional method, which includes 
obtaining a 3D model image by having the 3D model image created and rendered 

20 by a 3D graphic designer. Therefore, the 3D formed image having a similar 
quality to the conventional 3D model may be obtained at a low cost. 

According to an example embodiment of the present invention, the user 
information includes a user's primary size information, personal information, a 
user's location information, a user's style information and other 

25 coordination-related information or a combination thereof. 

According to an example embodiment of the present invention, generating 
the pseudo-3D user-adapted avatar image includes deriving a user's secondary 
size information automatically by using the primary size information and the 
personal information; and correcting the size of the 2D standard avatar image 
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automatically using the primary size information, the secondary size information 
and the personal information. 

According to an example embodiment of the present invention, the user 
information includes a facial image of the user and the facial image of the user is 
5 inserted into the generated avatar image. 

According to an example embodiment of the present invention, deriving 
the secondary size information includes automatically performing a deriving by 
an artificial intelligence algorithm based on ""national body size statistical data 
from the Korean Agency for Technology and Standards." 

10 According to an example embodiment of the present invention, correcting 

the size automatically in order to fit to a user's requirements includes dividing the 
2D standard avatar image and setting control points for each of the divided 
groups; linearly adjusting the size of the 2D standard avatar image according to a 
size change by . each group; and correcting a color value of each pixel according 

15 to the size adjustment. 

According to an example embodiment of the present invention, correcting 
the color value of each pixel according to the size adjustment, performs a 
correction of the color value of the pixel, according to the coordinate change of 
the pixel through a luminance value interpolation. 

20 For example, an individual's character is embodied as the pseudo-3D 

user-adapted avatar image by correcting the user size automatically by using the 
"national body size statistical data from the Korean Agency for Technology and 
Standards" and the received personal information. A relation equation is provided, 
which may estimate each size by parts through the personal information, such as 

25 age, and the primary size information such as a height, a weight, and a bust girth 
is provided from the "national body size statistical data from the Korean Agency 
for Technology and Standards." The secondary size information is obtained 
through the relation equation. When the 2D standard avatar image is divided by 
parts, the point corresponding to the part is fixed to the control point and the 



wo 2006/071006 



PCT/KR2005/004n3 



estimated value from the relation equation is applied to the control point. The 
size conversion by parts is performed by using the values from before and after 
the change of the control point, and applying a Hnear conversion and the 
luminance value interpolation. The present invention creates the individual's 
5 character by a simple operation from the 2D standard avatar image, unlike the 
methods by which the conventional invention creates the individual's character 
by converting a body through a complicated operation according to a thickness, a 
height, a width and the like from the 3D model. Therefore, the pseudo-3D 
user-adapted avatar image is created with a lower cost and time, wherein the 
10 pseudo-3D user-adapted avatar image is the individual's character having a 
similar quality to the conversion from the 3D model. 

A user's facial photo or a desired facial image is inserted into the 
generated pseudo-3D avatar so that the pseudo-3D user-adapted avatar image is 
created. 

15 According to an example embodiment of the present invention, inserting 

a facial image to the pseudo-3D user-adapted avatar includes extracting a facial 
image by extracting a facial color of a facial region from the facial image and 
detecting a specific facial region, and adjusting a size fitting to a body shape of 
the pseudo-3D user-adapted avatar. 

20 According to an example embodiment of the present invention, 

coordinating automatically includes: generating a most suitable pseudo-3D 
coordination image to the user by using the personal information, the user's 
location information, the user's style information and other coordination-related 
information or a combination thereof; embodying a result value deriving logic 

25 coordinating the pseudo-3D user-adapted avatar image using the generated 
pseudo-3D coordination image; acquiring modified information of the user 
related to the coordination result by the artificial intelligence algorithm; and 
reflecting the acquired modified information of the user to the result value 
deriving logic. 
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The database needs a number of tables for embodying the artificial 
intelligence system and the coordination result value is derived by combining the 
tables organically. 

A "standard 2D avatar image table" includes data for skin tone, hairstyle, 
5 eye shape, face appearance, face shape and the like is prepared. A "standard body 
size table" received from the "national body size statistical data from the Korean 
Agency for Technology and Standards" is prepared. 

A "standard 2D coordmation item image table" including the standard 
clothes image information and the accessories or additional item image 

10 information, a "2D pattern image table" including pattern image information, and 
a "pseudo-3D image converting reference value fixing table" including reference 
values for converting the 2D image to the 3D image are prepared. 

15 values of a "body shape and height" are derived by a sex, an age, a 
height, and a size from the prepared "body shape analyzing reference value 

15 table" and are referred to when outputting the coordination result values, wherein 
the 15 values are thin and medium, thin and very short, thin and very tall, thin 
and small, thin and tall, medium and mediuiri, medium and very short, medium 
and very tall, medium and short, medium and tall, fat and medium, fat and very 
small, fat and very tall, fat and small, and fat and tall. 

20 7 values of a "body type" are derived from the prepared "body type 

analyzing reference value table," wherein the 7 values are log-shaped, log-shaped 
and medium, medium, triangle-shaped, inverted triangle-shaped, inverted 
triangle-shaped, and medium and oval. 

A "table by items" is listed by items. In case of women, the table includes 

25 data for accessories, pants, blouses, coats, bags, cardigans, jackets, vests, jumpers, 
sweaters, caps, one-piece dresses, shoes, shirts, skirts and socks. In case of men, 
the table includes data for accessories, pants, coats, bags, cardigans, jackets, vests, 
jumpers, sweaters, caps, shoes, shirts, and socks. In this table an ID value, a color 
value and a pattern ID value of the standard 2D image corresponding to the 
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condition of the item are fixed in advance. 

A "personal information storage table" storing the personal information, 
the coordination information and the like is prepared. 

A "list table of possible criteria and conditions" is prepared. In this table, 
5 local weather information from a weather station for deriving weather; criteria of 
other people such as a friend, a lover, a senior, a junior, a colleague and a group; 
criteria by purpose such as a date, a meeting, a wedding, a visit of condolence, a 
party, an interview, fishing and climbing; criteria by place such as a company, a 
house, a dance club, a restaurant, a mountain, a river, a sea, a concert, a recital, a 
10 theater, an exhibition hall and a sports stadium; and a preferred style such as a 
suit, a semi-suit, casual or hip-hop are fixed in advance. 

A prepared "annual weather table" includes data of climate and weather 
like temperature, snowfall, wind speed, humidity, clouds, sunshine and the like 
for the previous 3 years, and 5-day and daily weather forecast information, 
15 A "condition generating table 1" for obtaining a result value is generated 

by an administrator at first. A "condition generatmg table 2" stores data received 
from the coordination program user. A completed table is generated after 
approval of the administrator. 

A "coordination result value deriving table" assembles each item and is 
20 linked with a "coordination condition-listing table." 

The present invention includes a "natural deriving result value table" and 
a "deriving result value ID numbers counting table" storing a user's behaviors, a 
'"user-corrected result value table" and a "corrected result value ID numbers 
counting table" reflecting a user's coordination opinion and other organically 
25 combined tables. 

The present invention provides an automatic coordination suitable to 
tastes of the user through the artificial intelligence searching system. Each group 
according to a fashion style, personal information, weather, a place, a job, other 
people and a purpose is generated from the artificial intelligence system. An 
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organic but independent relation is built between each group, and a group code 
according to each group is granted to a database-formed image. The coordination 
simulation system automatically selects an image suitable to the tastes of the user 
by the code search. Knowledge acquisition is performed by the user by selecting 
5 the coordination image directly, transmitting the coordination image from the 
artificial intelligence system to the coordination simulation system, granting the 
new code value and adding the code to the database. Conventional artificial 
intelligence systems are largely manually controlled, because the conventional 
artificial intelligence systems are tree-formed structures or searching forms that 

10 search according to a user's selection. The system of the present invention is 
divided into an automatic part and a manual part. 

In the automatic part, the coordination suitable to the tastes of the user is 
searched more accurately and quickly by having a property as an object 
independent from the fixed groups, and fixing the code from the organic relation 

15 among each group. 

In the manual part, the coordination using knowledge acquisition may be 
accurately suitable to tastes of the user. 

Therefore, the acquiring coordination simulation system may perform 
accurate and quick searching, unlike the conventional systems. 

20 EfTect of the Invention 

A service business method of the present invention includes registering 
standard 2D images of represented goods by classifying prepared goods and 
displaying recommended goods, similar to pseudo-3D item images derived from 
a pseudo-3D user-adapted coordination program by using artificial intelligence, 

25 because selling by preparing every derived goods as a coordination result is 
impossible. 

A seller requests a creation of the pseudo-3D item image of a registering 
item to an administrator server of the system and the administrator server 
registers the item by creating the pseudo-3D item image, or the seller buys a 
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pseudo-3D image creating software directly, creates the item image, requests 
approval of the pseudo-3D item image from the administrator of the system, and 
registers the pseudo-3D item image. A business or a seller who wants to use the 
system enters basic service member information in order to insert a code on the 
5 service homepage, is granted their own shop code through the entered 
information and generates an HTML tag based on the granted shop code in the 
service homepage. The generated HTML tag is inserted into their own website, a 
board and the like to sell the item, to advertise the item, to give publicity and to 
link items through e-mail. Therefore, a small-scale business, a SOHO business 

10 and the like, for whom it may be impossible to develop the coordination program 
directly, may install the coordination program of the present invention and may 
operate an online coordination service with their own items without high 
production and development costs. 

When a customer finds an item similar to the item image derived by the 

15 pseudo-3D user-adapted total clothes coordination program using artificial 
intelligence, the customer may buy the item or a recommended item through the 
present invention. Also, when the customer wants to buy an item lliat is the same 
as the derived pseudo-3D item image instead of the similar item and the 
recommended item, a custom-made order corresponding to the derived image is 

20 requested, and the custom-made production according to the detailed body shape 
information of the customer is performed. A design created by the customer, a 
desired pattem, a pattern created by the customer and the like may be uploaded in 
an item generating tool and an item assembling tool, so that a custom-made item 
including a user name, a user photo and the like is produced. 

25 A service business method of the present invention may evaluate a user's 

body shape information and a user's acquired coordination style through the 
pseudo-3D user-adapted coordination program using the artificial intelligence, 
may recommend a grade over a specific level according to the evaluated result to 
a fashion model candidate, and may link with scouting for models and 
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entertainers and related management businesses. 

Brief Description of the Drawings 

The above and other advantages of the present invention will become 
5 more apparent by describing in detail example embodiments thereof with 
reference to the accompanying drawings, in which: 

FIG. 1 is a conceptual view illustrating a pseudo-3D image converting 
module and a user-adapted total clothes coordinating method using artificial 
intelligence according to an example embodiment of the present invention; 
10 FIG. 2 is a conceptual view illustrating a generation of a pseudo-3D 

user-adapted avatar in the artificial intelligence system in FIG. 1 ; 

FIG. 3 is a conceptual view illustrating a module converting a 2D image to 
a pseudo-3D image; 

FIG. 4 is a conceptual block diagram illustrating a pseudo-3D total clothes 
15 coordination method according to an example embodiment of the present 
invention; 

FIG. 5 is a block diagram illustrating a face-inserting module; 

FIG. 6 is a view illustrating a 2D standard avatar according to an example 
embodiment of the present invention; 
20 FIG. 7 is a display view illustrating a 2D image item-generating tool 

according to an example embodiment of the present invention; 

FIG. 8 is a display view illustrating a 2D image item-assembling tool 
according to an example embodiment of the present invention; 

FIG. 9 is a display view illustrating a pseudo-3D image converting test 
25 tool according to an example embodiment of the present invention; 

FIG. 10 is a view illustrating a principle of a B-spline. 

FIG. 11 is a view illustrating a pseudo-3D surface after B-spline 
processing according, to an example embodiment of the present invention; 

FIGS. 12 through 14 are views illustrating a process of converting a 
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virtual 3D curved surface model to a 2D model according to an example 
embodiment of the present invention; 

FIG. 1 5 is a display view illustrating a pattern mapping test tool for the 
pseudo-3D image; 

5 FIG. 16 is a display view illustrating a dressing tool according to an 

example embodiment of the present invention; 

FIGS. 17 and 18 are views illustrating a size correction according to an 
example embodiment of the present invention; 

FIG. 19 is a view illustrating a principle of Ixmiinance value interpolation 
10 after the size correction according to an example embodiment of the present 
invention; 

FIG. 20 is a view illustrating filtering windows of images of Cb, Cr; 

FIGS. 21 through 24 are block diagrams illustrating a system structure 
using artificial intelligence; 
15 FIG. 25 is a conceptual view illustrating an online service business 

method using the pseudo-3D coordination according to an example embodiment 
of the present invention ; 

FIG. 26 is a display view illustrating an online service; and 

FIG. 27 is a display view illustrating a service in a portal site and the like. 

20 

Best Mode for Carrying Out the Invention 

It should be understood that the example embodiments of the present 
invention described below may be varied modified in many different ways 
without departing from the inventive principles disclosed herein, and the scope of 
25 the present invention is therefore not limited to these particular following 
embodiments. Rather, these embodiments are provided so that this disclosure 
will be through and complete, and will fully convey the concept of the invention 
to those skilled in the art by way of example and not of limitation. 

Hereinafter, the present invention will be described in detail with 
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reference to the accompanying drawings. 

FIG. 1 is a conceptual view illustrating a pseudo-3D image converting 
module and a user-adapted total clothes coordinating method using artificial 
intelligence according to an example embodiment of the present invention. 
5 Referring to FIG. 1, the coordination system comprises an artificial intelligence 
(AX) system 10 that generates a pseudo-3D user-adapted avatar and an 
image-converting module 20 that converts a standard 2D coordination image to a 
pseudo-3D coordination image. The user may feel as if the user is virtually 
wearing the clothes, because the dressed character 30 may be matched to an 

10 appearance adapted to the user when a pseudo-3D coordination image 22 is put 
on a pseudo-3D user-adapted avatar 12. 

FIG. 2 is a conceptual view illustrating a generation of the pseudo-3D 
user-adapted avatar in the AI system 10 in FIG. 1. Referring to FIG. 2, a standard 
2D avatar 12-1 is prepared based on the "national body size statistical data from 

15 the Korean Agency for Technology and Standards." Detailed information of a 
user such as a shoulder width, a waist girth, a hip girth and the like, based on 
basic information of the user like an age, a height, a bust girth and the like, are 
derived by algorithms applied by the AI system. The pseudo-3D user-adapted 
avatar is generated by converting the standard 2D avatar 12-1 to a fat type 12-2 

20 or a thin type 12-3 automatically, for example, a fat person to the fat type 12-2, 
or a thin and small person to the thin type 12-3. 

FIG. 3 is a conceptual view illustrating a module converting a 2D image to 
a pseudo-3D image. Referring to FIG. 3, basic clothes are designed by applying a 
button, a collar, a pocket, a color, a pattern and the like to the standard 2D image. 

25 A pseudo-3D image (that is, a 2.9D item image) converted from a basic item 
image is generated by the pseudo-3D image converting algorithms. 

FIG. 4 is a conceptual block diagram illustrating a pseudo-3D total clothes 
coordination method according to an example embodiment of the present 
invention. Referring to FIG. 4, the coordination system comprises an automatic 
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part 100 and an AI part 200. 

The automatic part 100 comprises a 2.9D converting module 110, a 
national body shape database searching module 120, an individual's character 
generating module 130, a pattern mapping and color correcting module 140 and a 
5 dressing module ISO. 

The 2.9D converting module 110 converts data from a 2D clothes image, a 
2D clothes development figure-creating module 112 to a 2.9D clothes 
coordination image. 

The national body shape database searching module 120 searches, using 
10 AI, for the most similar body shape data from the prepared national body shape 
database 124 according to personal information 122, such as an age, a size and 
the like. Secondary size information is derived by estimating size by parts of 
body through an equation from the National Standard Body Shape Investigative 
Report by the National Institute of Technology and Quality, using primary size 
15 information, which is personal information such as an age, a height, a weight, a 
bust girth from the "national body size statistical data from the Korean Agency 
for TechnolGg>' and Standards." 

The individual's character-generating module 130 generates the 
pseudo-3D user-adapted avatar by correcting the size of a model of the national 
20 average body shape 132 according to the primary size information and the 
secondary size information from the body shape database searching module 120. 

In addition, the individual's character-generating module 130 is linked to 
a user face-inserting module 134. The user face-inserting module 134 replaces a 
facial image of the generated character model with the facial image selected by 
25 the user, for example, a desired character of the user, the user's own photo image 
and the like. A detailed description is as follows. 

The pattern mapping and color-correcting module 140 corrects patterns 
and colors of the clothes coordination image produced by a 2.9D clothes 
coordination image database. 
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The dressing module 150 depicts a dressed individuars character through 
a display module 300 by combining the generated individual's character and the 
2.9D clothes coordination image with corrected patterns and colors. 

The AI part 200 comprises a color code and pattern database 210, a 2.9D 
5 clothes coordination image database 220, an AI searching module 230, an AI 
database 240 and an acquiring module 250. 

The acquiring module 250 acquires the received user coordination 
inclination data from a user coordination result-modifying module 252 and stores 
the acquired result by renewing the data in the AI database 240. Therefore, the 
10 user coordination inclination is acquired. 

The AI searching module 230 searches for the acquired user coordination 
style from the AI database 240 based on the personal information 232 according 
to the 5W1H principle. Each group is generated by applying artificial intelligence 
according to fashion style, personal information, weather, place, other people and 
15 purpose. Each group constructs organic but independent relations and grants a 
group code corresponding to each group to the database-formed coordination 
image. Goods suitable to tastes of user are selected automaticaiiy through a code 
search. 

The color code and pattern database 210 generates color code and pattern 
20 data according to the searched acquired user coordination inclination data to the ^ 
clothes database 220. 

The clothes database 220 stores the 2.9D clothes coordination image 
received from the 2.9D image converting module 110 and the 2.9D clothes 
coordination image with applied colors and patterns according to the searched 
25 acquired user coordination inclination data to the pattern mapping and color 
correcting module 140. 

The display module 300 links to a commercial transaction through a goods 
selling module 310 and a custom-made goods selling module 320 when the user 
wants to buy the 2.9D clothes coordination image coordinated in the depicted 
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individual's model. 

FIG. 5 is a block diagram illustrating a face-inserting module. Referring to 
FIG. 5, a user face-inserting module 134 composes a facial image entering part 
134a, a facial color extracting part 134b, a facial region detecting part 134c and a 
5 facial information inserting part 134d. 

The facial image entering part 134a receives a user photo image or a 
desired image from a user facial image uploading module 133 and converts the 
facial image except for the background and noise by filtering into a YCbCr 
format. 

10 The facial color extracting part 134b extracts a facial color region after 

receiving the filtered YCbCr face image. Converting image into the YCbCr 
format is for extracting a value of the facial color. Y represents a brightness value, 
that is, gray image information, and Cb and Cr represent color values. 

The facial image detecting module 134c detects a specific facial region 

15 from the extracted facial color region image. The facial image is divided into a Y 
image and Cb, Cr images and only the facial color component is extracted from 
each of the Cb, Cr images by using color pixel filtering. In this case, the 
extracted color component pixel is a skin color region value, except for a specific 
region of the face, and the facial region image may be derived as a gray image by 

20 applying the filtered Cb, Cr values to the Y image. The specific region value, for 
example, eyes, a nose, a mouth or the like, and the pixel value of the facial region 
are extracted by filtering the original facial image by the derived gray image. 

The facial information inserting module 134d adjusts the size of the 
extracted facial image to the pseudo-3D user-adapted avatar, deletes the facial 

25 image information of the generated pseudo-3D user-adapted avatar, inserts the 
adjusted facial image information into the deleted facial image information and 
then the pseudo-3D user-adapted avatar may be created. The avatar is transmitted 
to the individual's character-generating module 130. 

In a preparatory stage of the present invention, a 2D standard avatar image 
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is created to a 2D bitmap image file. The size of the background image is 240 x 
360. The 2D standard avatar image is created using an average age value of 18 to 
24 years old referring to the "national body size statistical data from the Korean 
Agency for Technology and Standards." 
5 FIG. 6 is a view illustrating a 2D standard avatar according to an example 

embodiment of the present invention. Referring to FIG. 6, the two main types of 
the 2D standard avatars are male and female, respectively. 

FIG. 7 is a display view illustrating a 2D image item-generating tool 
according to an example embodiment of the present invention. Referring to FIG. 

10 7, items such as a button, a pocket, a color and a pattern fi-om a figure of basic 
clothes are generated by the item-generating tool. A synthetic tool related to 
clothes is created as a basic program. 

The desired design is sketched on the 2D standard avatar in a standard 
clothes-drawing window 401 and the clothes are generated by using patterns and 

15 accessories and the like, according to the design in a pattern inserting window 
403 and an accessories window 405. 

FIG, 8 is a display view illustrating a 2D image item-assembling tool 
according to an example embodiment of the present invention. Referring to FIG. 
8, the item-assembling tool comprises NEW 402 and SAVE 404 features in the 

20 top menu. Basic clothes are selected in a basic clothes window 406, and the 
selected basic clothes are depicted in an operating window 408. The basic clothes 
of the operating window 408 are modified by selecting a button, a pocket, 
accessories, a collar, a color and a pattern in an appliance window 410. The 2D 
clothes coordination image is stored by selecting SAVE 404. 

25 FIG. 9 is a display view illustrating a pseudo-3D image converting test 

tool according to an example embodiment of the present invention. Referring to 
FIG. 9, the 2.9D image-converting tool comprises OPEN 502 and SAVE 504 
features in the top menu. The converted 2.9D coordination image is depicted in 
an operating window 506, and the converting tool comprises "HSI convert'' 510, 
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"generate grid" 512, "apply B-spline'* 514 and "generate 2.9D image" 516 
buttons. 

The created 2D coordination image is opened in an operating window 506 
by selecting OPEN 502 in order to convert the 2D coordination image created in 
5 the 2D coordination image-generating tool to the 2.9D coordination image. 
Hue-saturation-intensity (HSI) converting is performed on the 2D coordination 
image through the "HSI convert" 510 button. 

The HSI channel is a color having a hue, a saturation and an intensity, 
wherein the hue is depicted as an angle range from 0 to 360 degrees, the 
10 saturation corresponds to a radius range from 0 to 1 and the intensity is 
corresponds to the z-axis; that is, 0 indicates black and 1 indicates white. An HSI 
converting value from a red-green-blue (RGB) value is as below. 
[Expression 1 ] 

/ = j(/? + G + 5) 

15 [Expression 2] 

S = 1 [min(^,G,5)] 

[Expression 3] 

i[(i?-G) + (/?-5) 
H = cos-^ [ . ^ ] 
^(R-Gy+(R-B)iG-B) 

A lattice model of the 2D clothes coordination image is generated 

20 according to the intensity through the "generate grid" 512 button. The intensity 

value of each 2D image pixel is depicted on the z-axis. Because the depicted 3D 

surface is coarse, a surface smoothing technique is applied for generating a 

smooth 3D curved surface. The smooth 3D curved surface is generated through 

the "apply B-spline" 514 button. 

25 [Expression 4] 
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FIG. 10 is a view illustrating a principle of the B-spline. Referring to FIG. 
10, each P|, P2,. . , Pn+i indicates a set value of maximum and minimum values of 
the intensity value. A surface equation is represented as below by summing the 
10 above equations. 

[Expression 5] 

m n 
1=0 >o 

A surface formed as shown in FIG. 1 1 is obtained by using expression 5. 
After selecting "generate 2.9D image" 516, the predetermined z-axis value 
15 and the 2D image pixel value from the B-spline are applied to a shading function 
to generate an image similar to the 3D model image. As the applied shading 
technique, a phong shading technique is used to generate the smooth curved 
surface. The phong shading technique is a method of depicting the surface 
smoothly by using a normal vector of a surface and an average value of a normal 
20 vector of a vertex point. The shading equation is as below. 
[Expression 6] 

ACOL = BCOL X (AMB + (1-AMB) x (VLAVNI x VNL) 
VCOL: color value after converting 
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BCOL: color value before converting 
AMB: circumferential light 

VL: vector of light (seeing angle and beginning point of light) 
VNI: normal vector of intensity (dot product value of intensity vector) 
5 VNL: normal vector of light (dot product value of light vector) 

The 2.9D clothes coordination image is depicted similarly to the 3D 
clothes coordination image by an intensity processing such ais that illustrated in 
the operating window 506 in FIG. 9. The created 2.9D clothes coordination 
10 image is stored in the clothes database 220 by selecting SAVE 504. 

The color is corrected by changing the value of H in expression 3 of the 
HSI conversion. 

In the present invention, the clothes 2D mapping sources are created 
according to the clothes 2.9D image in order to correct the pattern. 

15 The clothes 2D development figure is created in the 2.9D 

image-converting module by using a surface generated from the B-spline 
according to parts of clothes. The mapping source is generated by putting the 2D 
model changed from the 3D curved surface on patterns. The conversion is 
feasible by using physical methods. 

20 FIGS. 12 through 14 are views illustrating a process of converting a 

virtual 3D curved surface model to a 2D model according to an example 
embodiment of the present invention. Referring to FIG. 12, the vertex point of 
the curved surface model is a particle having mass, and the line between the 
vertex points is considered as a spring. A force acting on the vertex point is as 

25 below. 

[Expression 7l 

F = Fg +F, +Fj +F^ 

wherein Fg is represented as below, where m denotes mass of the vertex 
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point and g denotes the acceleration of gravity. 
[Expression 8l 

wherein Fg is represented as below by Hooke's law, where ks denotes the 
5 modulus of elasticity. 
[Expression 9] 

F,=-*,(|L'|-|L|)i^ 

wherein L and L' denote edge vectors before and after changing the place 
of the vertex point, respectively. 
10 [Expression 10] 

(V--V).L- L- 

^''^'^ \V\ ^\V\ 

wherein V and V denote velocity vectors before and after changing the 
place of the vertex point, respectively. Fe denotes a force from outside. After 
obtaining the force acting on the vertex point, an acceleration of the vertex point 
15 is obtained by applying the equation of motion. A distance X is obtained by 
integrating the acceleration twice as below. 
[Expression 1 1 ] 

[Expression 12] 

20 a = a^x/a^r 

FIG. 12 is a view illustrating a boundary of the 3D curved surface, 
wherein the force from outside acts on the boundary. A direction of the force 
from outside is radical in order to smooth the 3D model. FIG. 13 is a view 
illustrating converting of the 3D model by acting gravity, elastic force, damping 
25 power and a force from outside compositively. FIG. 14 is a view illustrating the 
converted 2D model by smoothing of the 3D curved surface. The simulation is 
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executed by applying a force from outside, calculating the force acting on each 
vertex point by applying expressions 7 to 10, and calculating the distance of 
movement of the vertex point caused by the acting force by applying expressions 
1 1 and 12. As the process repeats, the force from outside spreads to each vertex 
5 point to then convert the 3D curved surface to the 2D model. 

The pattern correction is performed through a pattem mapping test tool in 
FIG. 15. The pattem mapping test tool comprises a clothes button 702, a 
development figure button 704, a pattem button 706, a mapping button 708, a 
clothes window 710, a development figure window 712 and a pattem window 

10 714. The 2.9D clothes coordination image is depicted in the clothes window 710 
by selecting the clothes button 702. The development figure of the 2.9D clothes 
coordination image is depicted in the development figure window 712 by 
selecting the development figure button 704. The patterns are depicted in pattem 
window 714 by selecting the pattem button 706. 

15 The pattem is created through scanning and outsourcing of silk fabrics. 

The mapping sources are generated by putting the created 2D model on 
the texture mapping patterns, and the pixel value of the square in the curved 
surface accorded with the square forming the mapping source is mapped to the 
vertex point forming the curved surface and the square formed from the vertex 

20 points in the created 2.9D image. 

Vurtual cylindrical coordinates corresponds to the pseudo-3D model 
generated from the pattem. The rectangular coordinates are converted from the 
corresponding cylindrical coordinates by cutting and unfolding the cylinder of 
the cylindrical coordinates. The generated mapping source is placed on the 

25 rectangular coordinates. In this case, the distance of the cylinder is calculated 
according to the coordinates of the mapping source and the distance value of the 
pseudo 2D model, which is a cylinder to be mapped, is calculated. The calculated 
value is stored in a distance buffer, and the colors of the distance value of the 
model to be mapped and the mapping source value stored in the distance buffer 
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are corrected by using an average filter and the pattern is mapped. 

Because the color correction and the pattern mapping of the 3D model can 
be performed freely, the coordination simulations using the 3D model have 
highly researched. However, applying the service on a website and wireless 
5 services is difficult, due to the long times required to creating the 3D model, and 
mapping textures and rendering. A method of correcting colors and patterns in 
2D is suggested to overcome these problems. 

Though the mapping method used in the conventional 3D model is applied 
in the present invention, the 3D curved surface is generated by converting the 2D 

10 image to the 2.9D image automatically through the B-spline, and color correction 
and pattern mapping are performed by using the 3D curved surface; thus, costs 
for creating the 3D model and time for rendering are saved. Therefore, the 
coordination simulation may be suitable for services on websites and wireless 
services. Design & Measurement (D&M) Technology Co., Ltd. has a similar 

15 system which uses a 2D image and a photo. The coordination system named 
VWS25 generates a curved surface manually by specifying a clothes region and 
corrects patterns and colors manually by producing a development figure suitable 
to the curved surface. The problem of the system is that the whole process has be 
done manually before correcting patterns and colors. On the other hand, the 

20 system of the present invention requires a shorter time to map because the whole 
process is performed automatically. 

FIG. 16 is a display view illustrating a dressing tool according to an 
example embodiment of the present invention. Referring to FIG. 16, the dressing 
tool comprises a selection menu for a male 802 and a female 804, a pseudo-3D 

25 user-adapted avatar-dressing window 806, a clothes window 808, an upper 
clothes button 810, a lower clothes button 812, a color button 814, a pattern 
button 8 1 6 and a dressing button 818. 

The male 802 or the female 804, which can be selected from the top menu, 
is displayed in the pseudo-3D user-adapted avatar-dressing window 806. Desired 
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clothes are displayed in the clothes window 808 by selecting from the upper 
button 810 and the lower button 812. A color and a pattern of the displayed 
clothes in the clothes window 808 are corrected by correcting through the color 
button 814 and the pattern button 816. After determining the desired color and 
5 the pattern, the pseudo-3D user-adapted avatar in the dressing window 806 is 
dressed with the clothes in the clothes window 808 by clicking the dress button 
818. 

The 2.9D image dressing of the pseudo-3D user-adapted avatar image is 
performed by setting up the degrees of clearness of the pseudo-3D user-adapted 
10 avatar image and the 2.9D image, subtracting the color value of the pseudo-3D 
user-adapted avatar image and dressing the 2.9D image by using the degrees of 
clearness. 

The individual's character of the present invention is generated by 
correcting sizes. 

15 The relations of each body size are derived referring to the national 

physical standard reports. 

Other sizes are derived as below from basic values like height, bust girth 
and age. 

[Expression 13] 

20 Shoulder width - -2.1443 + 0.1014 x age + 0.1611 x height + 0.1472 x 

bust girth 

Body width = -3.1576 - 0.0397 x age + 0.1 183 x height + 0.3156 x bust 

girth 

Bust width = -2.3943 + 0.1948 x age + 0.0633 x height + 0.2533 x bust 

25 girth 

Bust thickness = 1.3974 + 0.2088 x age - 0.0164 x height + 0.2454 x bust 

girth 

Shoulder height = -10.3699 + 0,1315 x age + 0.8565 x height + 0.0258 x 
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bust girth 

Waist height = -7.03570 - 0.3802 x age + 0.6986 x height - 0.0807 x bust 

girth 

Also, a control point is fixed by grouping the 2D standard avatar by parts. 
5 The fixed control point adjusts the image size fitting to the size change of each 
group. 

In addition, the specific region of 2D standard avatar is converted linearly 
with respect to the 4 control points fixed in the boundary of the converting region 
as shown in FIGS. 17 or 18, in order to change the height and the width of the 2D 
10 standard avatar at the same time. 

FIGS. 17 and 18 are views illustrating a size correction according to an 
example embodiment of the present invention. Referring to FIG. 17, the square 
CiCjCkCl represents the image region before the conversion. Referring to FIG. 
18, the square TiTjTkTl represents the image region after the conversion. The 
15 points Mc, Mr represent the center of gravity of the squares CiCjCkCI and 
TiTjTkTl respectively. Each square is divided to 4 triangles by using the center 
of gravity and the image is mapped by the divided triangles linearly. 

The mapping process from the pixel value P of the image before the 
conversion in the triangle CiMcCl in FIG. 17, to the pixel value P' of the image 
20 after the conversion in the triangle TiMrTl m FIG. 18 is described as below. The 
corresponding points P and P' are expressed as below by using the 2 sides of 
each triangle. 

[Expression 14] 

P= s ( Ci-MC ) + 1 ( Cl-MC ) + MC 
25 [Expression 15] 

P' = s ( Ti-MT ) + 1 ( Tl-MT) + MT 

The triangle CiMcCl is mapped to the triangle TiMyTl linearly, then s 
and t with respect to the corresponding points P and P' are the same. 
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Ci and Ti are expressed as Ci = (cxi,cyi,czi)T, Ti = (txi,tyi,tzi)T, 
respectively, and s and t are calculated by using the x and y pixel coordinate 
values of Ci, MC, CI and P and the x and y pixel coordinate values of P* are 
calculated by applying expression 14. 
5 Because the mapping is processed with the changes of shape, place and 

direction of the square according to expressions 14 and 15, the automatic 
conversion of the pseudo-3D user-adapted avatar image is easy. Also, the 2D 
standard avatar is converted naturally without discontinuity by parts and the like 
because the adjacent regions share the control point and the pseudo-3D 

10 user-adapted avatar image is generated with their own body sizes. 

FIG. 19 is a view illustrating a principle of luminance value interpolation 
after the size correction according to an example embodiment of the present 
invention. Referring to FIG. 19, the image color of the size-corrected avatar is 
corrected by the luminance value interpolation. The luminance value 

15 interpolation is the method of correcting the color value of the pixel according to 
the change of the coordinates of the pixel Generally, the place of the point P is 
not the place of a positive number pixel as shown in FIG. 18, and the luminance 
value of the point P is calculated from the pixel values from around the positive 
number location by using dual linear interpolation. 

20 [Expression 16] 

I{X,n) = (m + 1 - X)J{m,n) + - + 1, n) 

[Expression 17] 

I{X,n + 1) = (m + 1 " X)I{m,n-^ 1) + - m)I{m + 1,« + 1) 

[Expression 18] 

I{X, y) = (rt + 1 - + 1 - X)I{m, n) + {X- m)I(m + 1, «)} 
25 + (y - n){{m + 1 - X)I{m,n + 1) + (Jf - m)I{m + 1,« + 1))} 

wherein I(X,n) indicates the luminance value at the point of P = (X,Y,Z)^ 
and m,n are integers not greater than X, Y respectively. 
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The filtering of the facial image received in the "enter facial image" 134a 
step is removed by the below expression and the image in which noise is 
eliminated is converted to the YCbCr image. 
[Expression 19] 
5 Y =0.3 xR + 0.59xG-i-0.11 xB 

Cr = R- Y 
Cb = B-Y 

FIG. 20 is a view illustrating filtering windows of images of Cb, Cr. 
Referring to FIG. 20, the "extract facial region" 134b step extracts the facial 
10 region from the converted image of YCbCr through the filtering window with 
respect to the image of Cb, Cr. 

The "detect facial image" 134c step detects the facial image and the 
specific facial region of the original image by filtering the gray image Y in the 
extracted facial region image. 
15 The "insert facial information" 134d step inserts the detected facial region 

to the facial information data of the pseudo-3D user-adapted avatar and creates 
the pseudo-3D user-adapted avatar. 

Also, the size of the clothes is adjusted to fit to the converted size of the 
2D standard avatar. 

20 The control point of the clothes corresponding to the control point of the 

2D standard avatar is fixed, the size of the clothes is adjusted by the linear 
method fitting to the size change, according to the conversion of the 2D standard 
avatar, and the clothes are dressed on the avatar by gap fixing. Other clothes may 
be dressed on the avatar by using the relation corresponding to values between 

25 clothes and the avatar by the gap fixing. 

Also, the database about the user information, the use of simulation, the 
purchased goods and the like is constructed by an offline customer relationship 
management (CRM) program and the AI acquiring is achieved by transmitting 
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the database to the AI coordination simulation. 

By using the technique, selling of the goods, the custom-made goods and 
the like, through e-commerce on the web and on mobile services, may be 
possible, and the coordination service, processing derived images to produce 
5 contents and the like may also be possible. 

FIGS. 21 through 24 are block diagrams illustrating a system structure 
using artificial intelligence. Referring to FIG. 21, the user logs in 900 and the 
user information is recorded in a member information table 902, Also, feasible 
coordination criteria and condition information are recorded in a table of possible 

10 criteria and conditions 904. The coordination criteria is selected by a "select 
coordination criteria values of a user" 906 step referring to the "list table of 
possible criteria and conditions" 904. The body size information is recorded by 
an "average body size table" 908 according to the coordination criteria of the 
user received from the "select coordination criteria values of a user" 906 step. 

15 In addition, the weather information is extracted from an "extract 

forecasted weather information" 913 step referring to a "5-day weather forecast 
tabJe" 910 and an "annual weather table" 912 in order to apply the weather 
condition to the coordination criteria of the user. The user information and the 
selected information according to the user information are recorded in a 

20 "personal information storage table" 914. 

An "extract facial information" 916 extracts the image from a "standard 
2D avatar image table" 918 according to the information stored in the "personal 
information storage table" 914. An "avatar generating logic" 920 generates a 2D 
avatar 926 referring to the extracted facial information and the standard body size 

25 table. 

The "avatar generating logic" 920 analyzes the body shape and the body 
type and lists a "table of criteria values of body shape analysis" 922 and a "table 
of criteria values of body type analysis" 924 according to the body type and the 
body shape. 
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That is, the "avatar generating logic" 920 refers to the information of the 
"member information table" 902 first, the age, the sex, the body size (the height, 
the weight, the bust girth) and the like in the "list table of possible criteria and 
conditions" 904 second and the "average body size table" 908 completes the 2D 
5 avatar in the vhtual space by using expression 13, based on the standard body 
size detailed information (the neck girth, the shoulder width, the arm length, the 
underbust girth, the waist height, the hip girth, the leg length, the foot size and 
the like) corresponding to the user's body size. 

The 2D avatar image having the facial information and the body 

10 information is loaded with respect to the sex, the age, the facial shape, the skin 
tone, the hair style and the like in the coordination criteria values selected in the 
"personal information storage table" 914. The loaded 2D avatar image and the 
detailed body size information are combined and the pseudo-3D user-adapted 
avatar is generated by using the pseudo-3D conversion method. 

15 . The body characteristic of the generated avatar is obtained by analyzing 

the information value calculated in the "avatar generating logic" 920, and 
exiracting the user body shape and the user body type from the "table of criteria 
values of body shape analysis" 922 and the "table of criteria values of body type 
analysis" 924. The coordination style according to the body characteristic of the 

20 generated avatar is determined from the coordination style tables according to the 
body shape and the body type. Because the coordinating item is different 
according to the body shape and the body type, the body shape and the body type 
are extracted. 

The user specific information table is generated by analyzing the 
25 information stored in the "personal information storage table" 914. Referring to 
FIG. 22, the coordination style tables according to a facial shape 928, a sex 930, 
characteristics of an upper body 932, an age 934, characteristics of a lower body 
936, a season 938, a hah- style 940, other people 942, a skin tone 944, a purpose 
946, a weather 948, a place 950, tastes 952 and the like are listed. 
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Also, a ^'coordination style table according to body shape" 952 is listed by 
the criteria value of the body shape from the 'table of criteria values of body 
shape analysis" 922, and a "coordination style table according to body type" 956 
is listed by the criteria value of the body type from the 'table of criteria values of 
5 body type analysis" 924. 

A "coordination information extracting logic" 958 refers to each of the 
listed coordination style tables 928 through 956 in order to extract the 
coordination information. 

Referring to FIG. 23, a coordination information extracted from the 

10 "coordination information extracting logic" 958 is listed in a "coordination result 
value deriving table" 960. The coordination result value reflects the coordination 
acquiring result in the "coordination result value deriving table" 960. 

The "coordination information extracting logic" 958 derives the 
coordination styles by conditions stored in the coordination style tables according 

15 to the facial shape 928, the sex 930, the characteristics of the upper body 932, the 
age 934, the characteristics of the lower body 936, the season 938, the hair style 
940, -the other people 942, the skin tone 944, the purpose 946, the weather 948, 
the place 950, the tastes 952 and the like based on the coordination style 
according to the derived body shape and the body type and the information stored 

20 in the "personal information storage table" 914 and stores the derived result 
value in the "coordination result value deriving table" 960. Every result value is 
given code values according to the order of priority and the order of priority is 
coded according to the organic relation of the information of each table. The 
order of priority is given according to the characteristic by conditions and is a 

25 subject determining the type, the age, the size, the design, the season, the color, 
the body, shape, the sex and the like of the item. For example, in case of a 
miniskirt as the coordination result value, first the sex is coded to woman, and 
summer, teens and twenties, body havmg long leg, thin type and the like are 
coded by characteristic in turn. When the miniskirt is in fashion in winter, the 
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code value is given to precede the code of summer and winter. The given code 
value is stored in the "coordination result value deriving table" 960 after 
searching for the code proper to the characteristic in the "coordination 
information extracting logic" 958, and extracting the coordination information 
5 according to the order of priority. 

Referring to FIG. 24, an "optimum coordination value deriving logic" 962 
derives the optimum coordination value referrmg to the "coordination result 
value deriving table" 960. 

The "optimum coordination value deriving logic" 962 searches for the 
10 coordination result value record in the information stored in the "coordination 
result value deriving table" 960 according to the order of priority selecting logic 
and transmits the optimum coordination code value to a "natural deriving result 
value table" 964. 

The trend code counting the results generating number according to the 
15 use of the coordination simulation by the user and the type by code according to 
the order of priority selected through the "coordination result value derivmg 
table" 960 are analyzed, the optimum order of priority value is determined 
according to the selected coordination information and the code is generated 
according to the order of priority. Every result value is stored in the 
20 "coordination item listing table" 966. 

The coordination item code value most similar to the generated code value 
is derived by using the generated code value. The derived code values are stored 
in the "natural deriving resuh value table" 964 in the order of weight of the 
similarity. When the generated code value is not in the conventional coordination 
25 image data, the generated code value is stored to the new data. The coordination 
image is generated by combining the researched item groups corresponding to 
the code or the additional coordination image is generated by reporting to the 
administrator. 

The derived optimum coordination value is listed on the "natural deriving 
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result value table" 964. The natural derived result value is offered to the "natural 
deriving result value table" 964 and is used to select the corresponding 
coordination item. The selected coordination items are offered to a "standard 2D 
coordination item image table" 968, an "RGB color value" 970, a "2D pattern 
5 image table" 972 and the like. The referred values in the tables 968 through 972 
respectively are listed in a "detailed composition table by items" 974. The listed 
values of the "detailed composition table by items" 974 is offered to a "table of 
criteria values of pseudo-3D image conversion setting" 976. 

A "coordination result image combining logic" 978 generates the 

10 coordination result value 980 by applying the criteria values of the pseudo-3D 
image conversion to the generated avatar from the "generate avatar" 926 step. 

The "coordination result image combining logic" 978 loads the pattern 
item according to the coordination image from a "2D image pattern table" 972 
referring to the "coordination item listmg table" 966 corresponding to the 

15 "natural deriving result value table" 964, fixes color by extracting the standard 
2D item from the "standard 2D coordination item image table" 968, combines the 
comparison values from the "detailed composition table % items" 974, generates 
the combined pseudo-3D image based on the comparison value and the criteria 
value in the "table of criteria values of pseudo-3D image conversion setting" 976 

20 and displays the optimum coordination simulation suitable to the tastes of the 
user by applying the derived pseudo-3D image to the 3D user-adapted avatar. In 
this case, the alternative coordination simulation fetches the code value by the 
order of priority stored in the "natural deriving result value table" 964, combines 
the items and displays the coordination simulation as described above. 

25 The generated coordination result value 980 is offered to the acquiring 

logic in FIG. 24. 

Referring to FIG. 24, the coordination result value is checked in a "result 
value suitable?" 982 step, and the coordination result is completed 984 when the 
result value is suitable. However, when the result value is not suitable, whether 
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the alternative system is reflected is checked 986 and the alternative coordination 
result value is generated 988 when reflecting the alternative system. Whether the 
alternative result value is suitable is checked 990 and the coordination result is 
completed 984 when the alternative coordination value is suitable. 
5 When the coordination result is not suitable, the user-modified result value 

table 992 and the modified result value ID numbers counting table 994 are listed 
and the derived resuh value ID numbers from the natural deriving result value 
table 964 are listed on the derived result value ID numbers counting table 996. 
That is, when the user determines the coordination result value is not the style of 

10 the user, the user may load the alternative coordination system of their own 
accord or may process the coordination simulation proper to the tastes of the user 
by loading the coordination simulation manually. The alternative coordination 
system is the coordination simulation system alternating the nearest styles to the 
tastes of the user among the coordination information having the lower order of 

15 the priority without the optimum coordination value in the "coordination resuh 
value deriving table" 960. When the user determines the alternative coordination 
result is not proper to oneself, the user may proceed with the coordination 
simulation manually. In this case, the coordination result value coordinated by 
user manually is stored in the user-modified result value table 992, the stored 

20 value is offered to the modified result value ID numbers counting table 994 and a 
user trend logic 998 reflects the stored value to the optimum coordination 
deriving logic. 

The user trend logic 998 analyzes the ID counting values and offers the 
analyzed user coordination inclination result value to the optimum coordination 
25 value deriving logic 962. The offered coordination inclination result value is 
applied in the coordination value deriving logic 962 when deriving the next 
coordination fi-om the acquired user coordination inclination result. That is, the 
user trend logic 998 fetches the counting information value according to the 
coordination image data selected by the many users fi-om the modified result 
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value ID numbers counting table 994 and reflects the trend inclination by 
heightening the order of priority with respect to the trend characteristic value 
among the code value of the coordination image. Because the specific 
coordination image selected by the many users indirectly represents that the 
5 coordination image is in fashion, the order of priority of the trend inclination in 
the coordination image code value should be heightened. The order of priority of 
trend is determined according to the reflection ratio of the derived result value ID 
numbers counting table 996 and the modified result value ID numbers counting 
table 994, and the trend value is reflected to the optimum coordination deriving 

10 logic 962 in order to derive the optimum coordination result value. 

A "user-modified result by user suitable?" 1000 step checks whether the 
user-modified result is suitable. When the user-modified result is suitable, the 
result is reflected to the "user trend logic*' 998. 

However, when the user-modified result is not suitable 1000, the 

15 user-modified result is offered to the "pseudo-3D image converting test tool" 
1008 through the "item generating tool" 1002 and the "item assembling tool" 
1006 in order to correct the item. The result is listed on the ''condition generating 
table 2" 1010 and an "accept?" 1012 step determines whether the listed 
condition-generating tool is suitable. When the condition is suitable, a "condition 

20 generating table 1" 1014 is listed and the condition is applied to the 
"coordination result value deriving table" 960. 

When the user determines that the coordination image manually combined 
by the user is not suitable or wants the custom-made order, the user may create 
the items by using the item generating tool 1002 and the item assembling tool 

25 1006 and see the 3D converted item image through the pseudo-3D converting 
program. The generated items are reflected in the coordination simulation system 
after going through a sequence of steps and are generated in the new item group. 
The coordination image manufactured by the user is stored in the "condition 
generating table 2" 1010 and the administrator determines whether the 
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coordination image manufactured by the user is suitable in the "accept?" 1012 
step. When the administrator determines that the coordination image 
manufactured by the user is suitable, the "condition generating table 1" 1014 
reflects the coordination image manufactured by the user, the reflected 
5 coordination image is stored in the image table and the stored coordination 
images may be converted to the pseudo-3D images possible to be simulated. 

FIG. 25 is a conceptual view illustrating an online service business 
method using the pseudo-3D coordination according to an example embodiment 
of the present invention. 

10 A portal site, an auction site, a clothes fashion site or whatever online 

trader 410, a small-scale business or a small office, home office (SOHO) 
business registers the pseudo-3D item image for selling in the online service 
business server 400. The registered pseudo-3D item image is registered in the 
database of the coordination simulation system 402. 

15 The business 410 who wants to use the system may insert HTML tags 

based on the shop code granted from the managing server, according to the 
demand for the services on their own website or on the board and link to 
advertisements and the selling goods. 

FIG. 26 is a display view illustrating an online service and FIG. 27 is a 

20 display view illustrating a service in a portal site and the like. 

The website of the business 410 with the installed coordination program 
may present the coordination according to the user's 420 desired coordination 
including the individual's character fitting to the body shape information of the 
user, through the coordination simulation system 402. 

25 When the user 420 requests for the item after seeing the desired 

coordination, the online service business server 400 handles the displayed 
coordination image through the nonnal online customer's request process and the 
approval process. 

The business server 400 delivers the sold goods using typical delivering 
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methods and divides profits with the seller. 

When the customer requests the custom-made items, the business server 
400 requests the custom-made items by dispatching the custom-made order sheet 
to the seller, receives the custom-made items from the seller and delivers the 
5 custom-made items to the customer. 

The business server 400 evaluates the body shape condition and the 
fashion coordination of users 420, selects the most suitable users with a particular 
item as a model of the item, and then presents the user to the seller or links the 
user to an additional service such as scouts for models or entertainers. 
10 Having described the example embodiments of the present invention and 

its advantages, it is noted that various changes, substitutions and alterations can 
be made herein without departing from the spirit and scope of the invention as 
defined by appended claims. 

15 Industrial Applicability 

The present invention provides a method of creating a pseudo-3D image 
based on a 2D image so that an image with 3D quality is provided, and 
processing speed and available memory are increased by 2D image processing. 

The present invention provides a pseudo-3D total clothes coordination 
20 method saving costs and time, and provides diverse coordination using 
coordination image development based on a pseudo-3D converting module. 
Table 1 represents a comparison of the conventional 2D coordination systems 
and the 3D coordination system of the present invention. 

25 
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[Table 1] 





2D Image 


Low 
Quahty 3D 


High 
Quality 3D 


Pseudo-3D 


Production Costs 
(won) 


50,000 to 
100,000 


200,000 to 
500,000 


50,000,000 to 
hundreds of 
millions 


50,000 to 
100,000 


Production Time 
(hours) 


12 


72 


168 


6 


rrouucuon 
Program 


iilUSualOr, - 

Photoshop 


JU OUlOlO 

MAX 


JU dlUQlO 

MAX, MAYA 


2.9D Convert 


System 
R enii i rem ent^ 


Higher than 
Pentium 3 
400 MHz 


Higher than 
Pentium 3 
800 MHz 


Higher than 
Pentium 4 
LO GHz 


Higher than 
Pentium 3 
400 MHz 


Capacity 


IM 


Under 5M 


More than 5M 


Under IM 


Loading Speed 


High 


Medium 


Low 


High 


Rotation 


Impossible 


Possible 


Possible 


Possible 


Detail Level 


Low 


Medium 


High 


Medium 


Aesthetic View 


High 


Low 


High 


High 



The present invention has a similar visual quality to the 3D simulation 
system but has similar levels with the 2D simulation system with respect to 
5 production costs, production time, system requirements, capacity, loading speed 
and the like. 

In case of the 3D system having high quality, the production costs of the 
model character and the clothes coordination image are different according to a 
number of polygons. When the number of polygons is more than about 100,000, 
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the production costs may be about 50 million to more than 100 million Korean 
won, and the production time may be more than 1 month, wherein the number of 
polygons is a number of the surfaces forming a 3D model. In case that the 
number of polygons is fewer than 100 thousand, the costs may be different 

5 according to a detail level. For example, in case the number of polygons is about 
20 thousand, the costs may be about 500 thousand Korean won. 

Small-scale businesses and the SOHO businesses using systems having 
low specifications may not support the 3D coordination systems in real time and 
have difficulty in using the 3D coordination systems because of high costs. 

10 However, the high-quality coordination system of the present invention may 
provide an online real-time service with low costs, to facilitate selling of diverse 
goods. 

15 
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